Pilot of Direct Observation of Clinical Skills (DOCS) in a Medicine Clerkship: Feasibility and Relationship to Clinical Performance Measures

PURPOSE To assess the feasibility of Direct Observation of Clinical Skills (DOCS), a program for formative assessment of students' clinical skills during a medicine clerkship and to determine relationships between DOCS measures and other clinical performance measures. METHOD From August, 2004 through June, 2005, Medicine Clerks assigned to the primary on-campus clinical site were asked to participate in the pilot phase of the DOCS program. Students were asked to complete at least one DOCS exercise focused on interviewing, physical examination, or oral case presentation. RESULTS Of the 79 students who rotated on the Medicine Clerkship during the pilot period, 79% (n = 62) participated in DOCS, and 163 forms were submitted for evaluation. Seventy-seven percent (77%) of the clinical observations occurred while on-call or during daily rounds. Seventy-three (73%) of observations were completed in 30 minutes or less. In 89% of encounters students received at least 5 minutes of verbal feedback. Satisfaction ratings from both students and observers were "moderately satisfied" or better. Global ratings from DOCS physical exam and case presentation sections were strongly correlated with both faculty ratings of clinical performance and final clerkship grade. DOCS measures were not statistically related to clerkship written examination scores. CONCLUSIONS These data support the feasibility of the DOCS session for formative assessment of student interviewing, physical examination, and oral case presentation skills during a medicine clerkship. Observer ratings from DOCS physical examination and case presentation sections were found to be predictors of final clerkship grade.